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1. WHAT IS ELIZA? 


ELIZA is a program which allows you to converse with your 
computer. It is a particularly good way to show your machine off 
to friends, since most people find it fascinating to "talk" with 
ELIZA. 

ELIZA holds a conversation with you. You type a sentence to it, 
and it replies. A prepared script is used to determine its 
responses. The two scripts supplied on your disk are variations 
of DOCTOR, which makes ELIZA behave like a non-directive 
psychiatrist. 

IMPORTANT ; ELIZA with DOCTOR is not a "computer 
psychiatrist". It is not intended to provide 
psychiatric treatment or medical benefit of any kind. 

ELIZA was originally written in 1965 by Dr. Joseph Weizenbaum at 
MIT. The program soon became famous for its ability to make 
people think they were talking not with a computer but with a 
person. 

This version of ELIZA is a faithful recreation of Dr. 
Weizenbaum's original script interpreter, plus a few carefully 
selected new features. You can change ELIZA'S behavior by 
modifying the scripts provided, or even writing completely new 
ones. So ELIZA is not only a computer game, but also a 
programming language. 

Section 2 below tells how to run ELIZA. The remainder of this 
document describes the ELIZA script writing language. 
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To give you the opportunity to understand ELIZA in depth, we have 
also included a reprint of Weizenbaum' s original paper on ELIZA, 
from the Communications of the Association for Computing 
Machinery , January 1966 (Vol. 9 No. 1) . 

As you converse with ELIZA, and become familiar with the scripts, 
you will gain insight into just how much the program really 
understands, and what methods it uses to give the appearance of 
understanding. You may decide that ELIZA is not so much 
"computer intelligence" as simply computer cleverness. 
Regardless, you and your friends will find it an absorbing and 
amazing program. 


2. HOW TO RUN ELIZA. 


Before doing anything else, you should copy all the files from 
the ELIZA disk onto another disk, and store the distribution disk 
in a safe place. 

The ELIZA disk contains the following files: 

ELIZA.COM (or .ABS) The ELIZA program. 

DOCTOR. SCR The current DOCTOR script. 
ODOCTOR.SCR The original DOCTOR script. 

To run ELIZA, the ELIZA program and DOCTOR. SCR files should be on 
the same disk. (ODOCTOR is the older, original DOCTOR script. 
You can use it if you wish but it probably will not carry on as 
good a conversation.) 

ELIZA can run under CP/M and Heath/Zenith HDOS, and requires at 
least 40K of RAM. If ELIZA complains of insufficient memory, and 
you are using CP/M, be sure your system is configured for the 
full memory capacity of your computer. 

If you are using CP/M, set the default disk to the disk 
containing the ELIZA files. For example, if they are on disk B; , 
type the CP/M command 


B: 

Then execute ELIZA by typing the command 
ELIZA 

If you are using HDOS, and the ELIZA files are on SYO:, all you 
need to do is give the ELIZA command. If the files are on 
another disk, such as SYl: , type 

SYl: ELIZA 

ELIZA will load from disk, and then greet you. You should talk 
to ELIZA using complete English sentences. Press the RETURN key 
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when you have finished typing your response. Since ELIZA replies 
in capitals you may find the dialogue easier to follow if you 
type in lower case. 

To complete your conversation politely, type the word GOODBYE. 
(You may also leave abruptly by typing ctrl-C: that is, hold down 
the CTRL shift key and press C.) 

If you want to run a script file other than DOCTOR. SCR, use the 
command 


ELIZA scriptname 

If no extension is specified for the script file, ELIZA assumes 
the extension .SCR. 

If you want to record your conversation, when you first run ELIZA 
use the command 

ELIZA >filename 

where "filename" is any legal file name. On CP/M, "filename" can 
also be the device name LST: or PUN;. Or you can use the ctrl-P 
feature of CP/M to record the conversation on the printer. On 
HDOS , "filename" can be a disk file name, or a device such as 
LP: . 

Sometimes you will be in the middle of a conversation and begin 
to wish you had saved it. ELIZA remembers as much of the 
conversation as can fit in the computer memory, so you can still 
save much or all of it. To start saving while in the middle of 
an ELIZA conversation, type the one word sentence 

SAVE 

ELIZA will ask you for a file name, on which it will save as much 
of the conversation as it has stored, and everything from now on. 
If your computer has a lot of memory, or if you have not been 
talking long, you will probably be able to save the entire 
conversation. Otherwise, only the most recent part of the 
conversation will appear on the file. 


3. THE SECRETS OF ELIZA 


"It is said that to explain is to explain away," Weizenbaum says 
of ELIZA. Although its behavior is remarkable, its effects are 
produced by an inherently simple mechanism. As long as ELIZA 
remains a mystery, you will marvel at its cleverness. Once we 
explain its secrets to you, however, you may feel it is just a 
gimmick . 

Before reading further, therefore, we suggest you play with ELIZA 
as much as you like. Once you have studied its workings, you may 
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possibly find it less fun - or at least, a different kind of fun. 

By showing you how it works, we provide the opportunity for you 
to learn how easy it can be for a programmer to make computers do 
marvelous things. In particular, you will be able to change 
ELIZA'S conversational habits, and even write completely new 
scripts on whatever subject you like. 

Once you decide to proceed, we recommend you first read the 
introduction to Weizenbaum's paper, which is included at the end 
of this manual. Although we have tried to explain the script 
language simply and clearly in the following sections, it 
contains some details that might be confusing. Weizenbaum's 
paper, although written mainly for computer scientists, presents 
the same material from a broader viewpoint. So you may find the 
paper helpful after you have read the rest of this manual. 


4. THE ELIZA PROGRAMMING LANGUAGE. 


The behavior of the ELIZA program is based on a simple mechanism. 
Each sentence you type is processed, using a prepared script, 
according to the following four steps; 

Step 1. Look at the sentence and pick out _anv . keywords 
specified in the script. 

Step 2. Replace each keyword by a replacement word, if the 
script provides one. 

Step 3. See if the sentence matches any of the patterns 
specified in the script. 

Step 4. If a pattern match is found, prepare a reply using 
one of the rewriting rules associated in the script 
with that pattern. If no match is found, use one of 
the replies for "no match". 

For example, suppose you tell ELIZA 

YOU ARE REALLY HELPING ME. 

The keywords in this sentence are YOU and ME. The script gives 
the replacements YOU = I and ME = YOU, so the sentence is 
rewritten 

I ARE REALLY HELPING YOU. 

One purpose of replacements is to "turn around" the sentences you 
type to ELIZA, so it can repeat parts of them back to you. 
Notice, though, that not all keywords have replacements. So at 
this stage of the process, the rewritten sentence does not always 
make sense, although the eventual reply probably will. 
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Under the keyword YOU, the script contains the pattern 
(0 I ARE 0) 

"0" matches zero or more words, so this pattern matches your 
sentence, with the first 0 matching nothing (zero words) , and the 
second 0 matching "REALLY HELPING YOU". 

One of the rewriting rules for this pattern is 

(WHAT MAKES YOU THINK I AM 4 ?) 

The "4" means to insert in that place the 4th element of the 
pattern: the word(s) matching the second 0. So ELIZA would 
generate the response 

WHAT MAKES YOU THINK I AM REALLY HELPING YOU? 

This four step process, although simple in concept, can be 
confusing when you first try to understand it in detail. ELIZA 
itself can explain the process to you. If you invoke ELIZA using 
the command 

ELIZA -D 

the program will print all sorts of information as it loads and 
executes. In particular, it will print the keywords, patterns 
and reassembly rules it uses as it generates each response. So 
you may wish to first study the description below of ELIZA'S 
script language, and then, armed with a listing of the DOCTOR 
script, run ELIZA -D, type sentences to it, and try to follow 
along as it explains what it is doing. Remember that your 
operating system allows you to use ctrl-S and ctrl-Q to suspend 
printing so that you can read the output before it shoots off the 
screen. 


5. LISTS. 


An ELIZA script is made up of lists. A list is simply a set of 
words, numbers, and punctuation characters, enclosed in 

parentheses. For instance, 

(THIS LIST CONTAINS 5 THINGS) 

But a list can also contain another list; 

(THIS CONTAINS 4 (AND THIS IS ONE OF THEM) ) 

When writing lists, you must be extremely careful to get all the 
parentheses correct. The ELIZA -D command can help find 

parenthesis errors; see "Debugging Hints" in Section 9. 
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6. SCRIPTS AND RULE LISTS. 


An ELIZA script is a text file containing lots of rule lists . 
You can prepare a script using any text editor program, such as 
PIE, ED or EDIT. You may use upper and lower case in the script; 
ELIZA translates everything to upper case. 

The DOCTOR script provided with ELIZA contains many examples of 
rule lists. You may want to study it while reading the following 
sections . 


First, we are going to show the most general form of rule list. 
We will use braces {} to enclose items that may be either 
included or left out. Ellipses (...) indicate that you can 
include more than one of the preceding item. Then most rule 
lists are of the form 


(keyword 


= replacement} {priority} 

DLIST (/ list name ...) } 

(pattern reassembly ...) ... } ) 


An example of a rule list containing all the above elements is 

(YOU = 13 DLIST (/ PERSON) 

((Oil YOU 0) (OH, YOU 3 ME?)) 

((0) (WHAT ABOUT ME?) (TELL ME ABOUT YOU))) 


This is complicated, but we will go through each part of the rule 
list and explain it. As we do, you should keep in mind the four 
steps (Section 4) which ELIZA uses to generate its response to a 
user's sentence. 


The first thing in a rule list is the keyword. This is the way 
the script defines the keywords used in Step 1 of the ELIZA 
conversation process. In the above example, the keyword is YOU. 

If the next thing is the character "=" and a replacement word, 
then every time the keyword is seen in a typed input, it is 
immediately replaced by the replacement word (Step 2) . In the 
example, the replacement is I. Every YOU typed by the user is 
replaced by I. If there is no "= replacement", the keyword is 
left as it was typed. 

The next thing in the rule list is an optional priority for the 
keyword. This is a number between 0 and 127. If no priority is 
specified, 0 is assumed. 

The priority is used in deciding which keyword in a sentence to 
consider first. As ELIZA scans an input sentence, it places each 
keyword it sees on a stack. If the keyword has a higher priority 
than any of the ones already seen, it is placed on top of the 
stack. Otherwise, it is placed on the bottom. 

When the sentence has been read, ELIZA considers the keywords in 
the order they appear on the stack. Thus, the highest priority 
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keyword in a sentence is used first. If two keywords both have 
the highest priority, the one on the left is used first. 

If the next thing in the rule list is the word DLIST, then the 
keyword is placed on one or more word lists. In the example, YOU 
is placed on the word list called PERSON. Word lists provide a 
way to define a category of words for use in a pattern, as 
explained in the next section. 


7 . PATTERNS . 


The last thing in a rule list is one or more transformation 
rules. Each transformation rule consists of a pattern followed 
by one or more reassembly rules . Once the highest priority 
keyword has been selected from the user's sentence, an attempt is 
made to apply each transformation rule for that keyword, in turn. 
This is Step 3 of the response generation process. 

The first transformation rule in our example is 

((Oil YOU 0) (OH, I 3 ?) ) 

This consists of the pattern 

(Oil YOU 0) 

and the single reassembly rule 
(OH, 13?) 

The items in the pattern are used, left to right, to try to match 
the user's sentence. Here are the things you can use in a 
pattern: 

0 The digit 0 matches any sequence of words, including 

the "sequence" containing no words. If 0 is not the 
last item in the pattern, it will match the smallest 
sequence before a match for the next item. 

number Any other number matches any sequence containing 
exactly that many words. Thus, 3 will match any 
three words. 

word Any word will match just that word. Remember that 
keyword replacement (Step 2) is performed before 
matching (Step 3) , so to match a keyword that is 
replaced, you must use its replacement. 

(* word . . . ) 

A list beginning with will match any of the 

words in the list. For example, in the pattern 


(0 YOU (* WANT NEED) 0) 
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the third item in the pattern will match either WANT 
or NEED. 

(/list) This will match any element on the word list named 
LIST. For example, in the DOCTOR script, the 
keywords MOTHER, FATHER, SISTER, etc. , are all 
placed on the FAMILY word list using the DLIST 
feature. Then the pattern element (/FAMILY) will 
match any of these words. 

Thus, the rule 

(Oil YOU 0) 

will match any sentence containing the phrase "I (one word) YOU", 
with any number of words (including none) before and after. 
Notice that, if the keyword replacements YOU = I and ME = YOU 
were in this script, the user would actually have to type "YOU 
(one word) ME" in order to match this pattern after replacement. 

If the first element in a pattern is not 0, that pattern will 
only match starting at the beginning of a sentence. If the last 
element is not 0, the end of the pattern must come at the end of 
a sentence in order to match. Thus, 

(I 0 YOU) 

will match any sentence starting with I and ending with YOU. 
(Note that ELIZA treats commas just like periods: what comes 
after the comma is a new sentence.) 

The pattern (0) is used often. It will match any sentence. 


8. REASSEMBLY RULES. 


Recall that a transformation rule consists of a pattern followed 
by one or more reassembly rules. If the pattern is found to 
match the user's input sentence, ELIZA applies the first 
reassembly rule in order to generate a new sentence, which it 
prints as its reply. The reassembly rule is then moved to the 
end of the list. So if there are several reassembly rules for 
one pattern, they are used in rotation as the conversation 
progresses . 

Most reassembly rules are simply lists of words and numbers. To 
create the reply, ELIZA replaces each number in the rule with the 
part of the input sentence that matched the corresponding pattern 
element. For example, if the input was 

SOMETIMES YOU BOTHER ME 

and the transformation rule was our old friend 


ELIZA - 9 - REASSEMBLY RULES 

((Oil YOU 0) (OH, I 3 YOU?)) 
then, after rewriting the input sentence to 
SOMETIMES I BOTHER YOU 

the pattern gives a match, with the ”1" matching BOTHER. In this 
case, the reassembly rule would replace the 3 by the match, 
BOTHER, for the third element in the pattern, "1”. Then ELIZA 
would reply 

OH, I BOTHER YOU? 


9 . SPEC lAL FEATURES . 


The special transformation rule 
(= keyword) 

is like a GOTO in other programming languages. It tells ELIZA to 
immediately begin trying to apply the transformations associated 
with that keyword. For instance, suppose there is a rulelist for 
the keyword WAS, and you want to treat WERE the same as WAS. You 
could use the following rulelist for WERE: 

(WERE = WAS (=WAS) ) 

This replaces WERE by WAS in the input, and then starts checking 
the patterns for WAS. 

(=keyword) can also be used as a reassembly rule. Note that it 
can be one of several reassembly rules following a pattern, or 
the last of several transformation rules for a keyword. (It 

should be the last because you'll never get past it to the 
others. ) 


NEWKEY. 


There are several other special reassembly rules. The rule 
(NEWKEY) 

tells ELIZA to give up on the current keyword and try finding 
another one in the input sentence. It often appears as part of 
the last transformation rule for a keyword: 


((0) (NEWKEY)) 
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PRE. 


The reassembly rule 

(PRE (reassembly) (=keyword)) 

is used to reassemble the input sentence, and then go back and 
try pattern matching again. The input sentence is reassembled 
according to the reassembly rule, and control is then transferred 
to the rule list for the specified keyword, for attempted 
matching on the transformed input. 

For example, DOCTOR contains the transformation 

(I'M = YOU'RE ((0 YOU'RE 0) (PRE (YOU ARE 3) (=1)))) 

If the input sentence is 

SOMETIMES I'M VERY HAPPY. 

it is rewritten to 

SOMETIMES YOU'RE VERY HAPPY. 

If I'M is the highest priority keyword in the sentence, the 
pattern (0 YOU'RE 0) will always match. The PRE rule rewrites 
the input as 

YOU ARE VERY HAPPY 

and the rule list for the keyword I is then used to try to match 
this sentence. 


NONE. 

ELIZA breaks up the user's typed input into one or more 
sentences, separated by any punctuation such as period, comma, 
dash, and so on. Each of these sentences in turn is searched for 
keywords, and a pattern match sought. 

The reserved keyword 

NONE 

is invoked whenever ELIZA is unable to find a keyword in the 
input, or to match any pattern for the keywords that do appear. 
Every script must contain a rulelist for NONE. 


EXIT. 

If a reassembly rule begins with =EXIT, it has a special effect. 
The remainder of the rule is printed as the output, without any 
substitution, and ELIZA terminates its execution. (This feature 
was not in Weizenbaum's original program.) 
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MEMORY . 

A script may contain one or more rulelists of the form 

(MEMORY keyword transformations ...) 

These rulelists look just like any other, except for the addition 
of the word MEMORY. The keyword must have a rulelist of its own 
elsewhere in the script. 

When the keyword is selected for transformation, before invoking 
the keyword's own rulelist, an attempt is made to match the 
patterns in the MEMORY rulelist. If a match is found, the 
resulting output is not printed on the terminal, but is stored 
away. 

When five responses have passed since the last time a MEMORY 
response was either stored or recalled, and no keyword match is 
found, instead of using a NONE reply ELIZA will print the oldest 
stored MEMORY response. 


DEBUGGING HELP. 


As mentioned in Section 4, running ELIZA with the command 
ELIZA -D 

produces debugging printout of various sorts. You can also use 
ELIZA -D >file 

to record the output on a disk file. Besides explaining the 
pattern match process, ELIZA provides several other kinds of 
output that may be useful in writing or modifying scripts. 

The input rules are printed as they are read from the script 
file. This can be helpful in finding missing or extra 
parentheses . 

After loading the script, ELIZA prints out the amount of memory 
remaining. This memory is used to store the conversation for the 
SAVE feature, and its size is also a clue to how much larger your 
script can become before it can no longer fit in memory. 
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APPENDIX I 


Following is Dr. Weizenbaum' s research paper on ELIZA, reprinted 
by permission from the January 1966 Communications of the 
Association for Computing Machinery . 


ELIZA — A Computer Program 
For the Studv of Natural Lauiniaae 
Communication Between Man 
And Machine 

Joseph Weizenbaum 

M aasachuselts Institute of Technology * * Cambndge, Mass. 

ELIZA is a program operating within the MAC time-sharing 
system at MIT which makes certain kinds of natural language 
conversation between men and computer possible. Input sen- 
tences are analyzed on the basis of decomposition rules which 
are triggered by key words appearing in the input text. 
Responses ore generated by reassembly rules associated with 
selected decomposition rules. The fundamental technical prob- 
lems with vdiich ELIZA is concerned are; (1) the identification of 
key words, (2) the discovery of minimal context, (3) the choice 
of appropriate transformations, (4) generation of responses in 
the absence of key words, and (5) the provision of an editing 
capability for ELIZA “scripts'*. A discussion of some psychologi- 
cal issues relevant to the ELIZA approach as well as of future 
developments concludes the paper. 

Introduction 

It ia said that to explain is to explain away. This maxim 
is nowhere so well fulfilled as in the area of computer 
programming, especially in what is called heuristic pro- 
gnimining and artificial intelligence. For in thase realms 
machines are made to behave in wondrous ways, often 
:>ufficient to dazzle even the most experienced observer. 
But once a particular program is unmasked, once its 
inner worldngs are explained in language sufficiently plain 
to induce understanding, its magic crumbles away; it 
stands i-evealed as a mere collection of procedures, each 
quite comprehensible. The obser\Tr says to himself ‘T 
could have written that’*. With that thought he mov^^ the 
program in question from the shelf marked “intelligent”, 
to that reserved for curios, fit to be discussed only with 
people less enlightened than he. 


Work reporierl herein was supported (in part) by Project MAC, 
an MIT research program sponsored by the Advanced Research 
Projects .\geiicy, Deparrinent of Defense, iiufler Office of Naval 
Research Contract Number Nonr-4102(01). 

• DepartiULMit of Electrical Engineering. 
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The object of tliis paper is to cause just such a re- 
evaluation of the program about to be “explained”. Few 
programs ever needed it more. 

ELIZA Program 

ELIZA is a program which makes natural language 
conversation with a computer possible. Its present imple- 
mentation is on the MAC time-sharing system at MIT. 
It is written in MAD-Slip [4] for the IBM 7094. Its name 
was chosen to emphasize that it may be incrementally 
improved by its users, since its language abilities may be 
continually improv'ed by a “teacher”. Like the Eliza of 
Pygmalion fame, it can be made to appear even more 
civilized, the relation of appearance to reality, however, 
remaining in the domain of the playwright. 

For the present purpose it is sufficient to characterize 
the MAC system as one which permits an individual to 
operate a full scale computer from a remotely located type- 
writer. Tlie individual operator has the illusion that he is 
the sole user of the computer comple.x, while in fact others 
may be “time-sharing” the system with him. What is 
important here is that the computer can read messages 
typed on the typewriter and respond by wTiting on the 
same instrument. Tlie time between the computer’s 
receipt of a mes.siige and the appearance of its response is 
a function of the prognun controlling the dialogue and of 
such MAC system parameters as the number of users 
currently corresponding with the s\''stem. These latter 
parameter generally contribute so little to the overall 
response time that conversational interaction with the 
computer need never involve truly intolerable delays. 

When in conversation with ELIZA, the user types in 
some statement or set of statements in natural language 
using normal punctuation and sentence structures. Only 
the question mark may not be used, because it is inter- 
preted as a line delete character by the MAC S3rstem. The 
user’s statement is terminated by a double carriage retiun 
which serves to turn control over to ELIZA. ELIZA then 
analyzes the user’s statement and generates some response 
which it types out. Control is then again with the user. 

A typical conversation is the following: 

Men are all alike. 

IN WHAT WAY 

Thev^re alwavs bnggiru? ti.s about .something or other. 

CAN V(.)U THINK OF A SPECIFIC EXAMPLE 
Well, my bovfriend made me eome hei-e. 

VOUR BOYFRIEND MAl>E Yol^ COME HERE 
He savs I’m depressed rxiuch of the time, 
r AM* SORRY TO HEAR YOU .ARE DEPRESSED 

Vfiiuititf ^ ! ’Number I January. l%6 


It's true. I am uiihappv. 

DO YOU THINK COMING HERE WILL HELP YOU NOT TO 
BE UNH.YPPY 

I need dome help, that much seems certain. 

WHAT WOULD IT MEAN TO YOU IF YOU GOT SOME HELP 
Perhaps I could learn to get along with my mother. 

TELL ME MORE ABOUT YOUR FAMILY 
Mv mother takes care ot’ me. 

WHO ELSE IN YOm FAMILY TAKES C*\RE OF YOU 
My father. 

YOITR FATHER 

You are like my father in some wavs. 

WHAT RESEMBL.YNCE DO YOU SEE 

You are not very aggressive but I think you don’t want me to 
notice that. 

WHAT ^L\KES YOU THINK I AM NOT VERY AGGRESSIVE 
You don't argue with me. 

WHY DO Y^OU THINK I DON'T \RGUE WITH YOU 
You are afraid of me. 

DOES IT PLEASE Y’OU TO BELIE\’E I -\M AFRAID OF YOU 
My father is afraid of ever\'body. 

WHAT ELSE COMES TO MIND WHEN YOU THINK OF 
YOUR FATHER 
Bullies. 

DOES THAT HAVE .ANYTHING TO DO WITH THE FACT 
THAT YOUR BOYFRIEND MADE YOU COME HERE 

The capitalized lines are the machine responses. 

The gross procedure of the program is quite simple; the 
text is read and inspected for the presence of a keyword. 
If such a word is found, the sentence is transformed 
according to a iide associated ^ith the keyword, if not a 
content-free remark or, under certain conditions, an earlier 
transformation is retrieved. The text so computed or 
retrieved is then printed out. 

In detail, of course, the procedui*e sketched above is 
considerably more complex. Keywords, for example, may 
have a RANK or precedence number. The procedure is 
sensitive to such numbers in that it will abandon a key- 
word already found in the left-to-right scan of the text in 
favor of one having a higher rank. Also, the procedure 
recognizes a comma or a period as a delimiter. Whenever 
either one is encountered and a keword has already been 
found, all subsequent text is deleted from the input mes- 
sage. If no key had yet been found the phrase or sentence 
to the left of the delimiter (as well as the delimiter itself) 
is deleted. As a result, only single phrases or sentences are 
ever transformed. 

Keywords and their associated transformation^ rules 
constitute the SCRIPT for a particular class of con- 
versation. An important property of ELIZA is that a 
script is data; i.e., it is not part of the program itself. 
Hence, ELIZA is not restricted to a particular set of 
recognition patterns or responses, indeed not even to any 
specific language. ELIZA scripts exist (at this writing) in 
Welsh and German as well as in English. 

The fundamental technical problems with which ELIZA 
must be preoccupied are the following: 

(1) The identification of the ‘‘most important^’ key^vord 


^ The w-ord “tranatormation” is used in its generic sense rather 
than that given it by Harris and Chomsky in linguistic contexts. 


occurring in the input me.ssage. 

(2) The identification of .some minimal context within 
which the chosen keyword appears; e.g., if the key^vord is 
•*you'\ is it followed by the word ‘\are’^ ;in which case an 
assertion is probably being made). 

(3) The choice of an appropriate transformation rule 
and, of course, the making of the tnmsformation itself. 

(4) The provision of mechanism that ^vill permit 
ELIZA to respond “intelligently'* when the input text 
contained no keywords. 

(5) The provision of machinery that facilitates editing, 
particularly extension, of the .script on the script writing 
level. 

There are, of course, the usual constraints dictated by 
the need to be economical in the use of computer time and 
storage space. 

The central issue is clearly one of text manipulation, 
and at the heart of that issue is the concept of the trans- 
formation rule which has been said to be associated with 
certain keywords. The mechanisms subsumed under the 
slogan “transformation rule" are a number of Slip func- 
tions which serve to (1) decompose a data string according 
to certain criteria, hence to test the string as to whether it 
satisfies these criteria or not, and (2) to reassemble a 
decomposed string according to certain assembly specifica- 
tions. 

While this is not the place to discuss these functions in 
all their detail (or even to reveal their full pow’er and 
generality), it is important to the understanding of the 
operation of ELIZA to describe them in some detail. 

Consider the sentence *T am very imhappy these days". 
Suppose a foreigner with only a limited knowledge of 
English but with a very good ear heard that sentence 
spoken but understood only the first two words “I am". 
Wishing to appear interested, perhaps even sympathetic, 
he may reply “How long have you been very unhappy 
these days?" What he must have done is to apply a kind 
of template to the original .sentence, one part of which 
matched the two words *T am** and the remainder isolated 
the w'ords “very unhappy these days*’. He must also have 
a reassembly kit specifically associated with that template, 
one that specifies that any sentence of the form ‘T am 
BLAH" can be transformed to “How long have you been 
BLAH", independently of the meaning of BLAH. A 
somewhat more complicated example is given by the 
sentence “It seems that you hate me". Here the foreigner 
understands only the words “you" and “me"; i.e., he 
applies a template that decomposes the sentence into the 
four parts: 

(1) It 3eems that (2) you (3) hate (4) me 

of which only the second and fourth parts are understood. 
The reassembly rule might then be “What makes you 
think I hate you"; i.e., it might throw away the first 
component, translate the two lal 0 ^^^l words (“you" to 
“I" and “me" to “you") and tack on a stock phrase 
(What makes you think) to the front of the reconstruction. 
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A formal notation in which to represent the decomposition 
template is: 

.0 YOU 0 ME) 
and the reassembly rule 

(WHAT M.\KES YOU THINK I 3 YOU). 

Tlie “O'’ in the decomposition rule stands for “an in- 
definite number of words" (analogous to the indefinite 
dollar sign of Comit) [6] while the “3" in the reassembly 
rule indicates that the third component of the subject 
decomposition is to be inserted in its place. The decom- 
position rule 

(0 YOU 1 ME) 

would have worked just as well in this specific example. A 
nonzero integer “n" appearing in a decomposition rule 
indicates that the component in question should consist 
of exactly words. However, of the two rules shown, 
only the first would have matched the sentence, “It seems 
you hate and love me," the second failing because there is 
more than one word between “you" and “me". 



In ELIZA the question of which decomposition rules to 
apply to an input text is of course a crucial one. The input 
sentence might have been, for example, “It seems that 
you hate," in which case the decomposition rule (0 YOU 
0 ME) would have failed in that the word “ME" would 
not have been found at all, let alone in its assigned place. 
Some other decomposition rule would then have to be 
tried and, failing that, still another until a match could 
be made or a total failure reported. ELIZA must therefore 
have a mechanism to sharply delimit the set of decom- 
position rules which are potentially applicable to a cur- 
rently active input sentence. This is the keyword mecha- 
nism. 

An input sentence is scanned from left to right. Each 
word is looked up in a dictionary of kejavords. If a word 
is identified as a keyword, then (apart from the issue of 
precedence of keywords) only decomposition rules con- 
taining that keyword need to be tried. The trial sequence 
can even be partially ordered. For example, the decom- 
position rule (0 YOU 0) associated with the keyword 
“YOU" (and decomposing an input sentence into (1) all 
words in front of “YOU", (2) the word “YOU", and (3) 
all words following “YOU") should be the last one tried 
since it is bound to succeed. 

Two problems now arise. One stems from the fact that 


almost none of the words in any given sentence are repre- 
sented in the keyword dictionarj". The other is that of 
“associating" both decomposition and reassembly niles 
with keyword.^. The first is serious in tliat the determina- 
tion that a word is not in a dictionary may well require 
more computation (i.e., time) than the location of a word 
which is represented. Tlie attack on both problems begins 
by placing both a keyword and its associated rules on a 
list. The basic format of a typical key list is the following: 

{K ((A) [Rui) (ffi.2) ••• (Rum,)) 
i{D,) (Ru ,) (^Ru A • • • (Rt. «,)) 

((Dn) (R.,l) (i?n.2) ••• (k.mj)) 

where K is the key^vord, D, the ith decomposition rule 
associated with K and Ri, / the jih reassembly rule asso- 
ciated with the ith decomposition rule. 

A common pictorial representation of such a structure 
is the tree diagram shown in Figure 1. The top level of 
this structure contains the keyword followed by the names 
of lists; each one of which is again a list structure beginning 
with a decomposition rule and followed by reassembly 
rules. Since list structures of this t3rpe have no predeter- 
mined dimensionality limitations, any number of decom- 
position rules may be associated with a given keyrvord and 
any number of reassembly rules with any specific decom- 
position rule. Slip is rich in functions that sequence over 
structures of this type efficiently. Hence programmin 
problems are iiiinimized. 

An ELIZA script consists mainly of a set of list struc- 
tures of the type sho^m. The actual keyword dictionary is 
constructed when such a script is first read into the 
hitherto empty program. The basic structural component 
of the keyword dictionary is a vector KEY of (currently) 
128 contiguous computer words. As a particular key list 
structure is read the keyword K at its top is randomized 
(hashed) by a procedure that produces (currently) a 7 
bit integer “f". The word “alway's", for example, yields 
the integer 14. KEY(i), i.e., the ith word of the vector 
IyEY, is then examined to determine whether it contains 
a list name. If it does not, then an empty list is created, 
its name placed in I'^Y(i), and the key fist structure in 
question placed on that list. If KEY(i) already contains a 
list name, then the name of the key list structure is placed 
on the bottom of the list named in IvEY(i). The largest 
dictionary so far attempted contains about 50 keyw'ords. 
No list named in any of the words of the I^Y vector 
contains more than two key fist structures. 

Every word encountered in the scan of an input text, 
i.e., during the actual operations of ELIZA, is randomized 
by the .^ame hashing algorithm as was originally applied to 
the incoming keywords, hence yields an integer which 
points to the only possible fist structure which could 
potentially contain that word as a keyword. Even then, 
only the tops of any key list structures that may be found 
there need be interrogated to determine whether or not a 
keyword has been found. By virtue of the various list 


38 


Communications of the AC3I 


Volume 9 / Number I j January, 1966 


sequencing operations that Slip makes available, the 
actual identification of a keyword leaves as its principal 
product a pointer to the list of decomposition (and hence 
reassembly) rules associated with the identified key^vord. 
One result of this strategy is that often less time Ls required 
to discover that a given word is not in the keyword dic- 
tionary than to locate it if it is there. However, the location 
of a keyword yields pointei*s to all information associated 
with that word. 

Some conversational protocols require that certain 
transformations be made on certain words of the input text 
independently of any contextual considerations. The first 
conversation displayed in this paper, for example, requires 
that first person pronouns be exchanged for second person 
pronouns and \dce versa throughout the input text. There 
may be further transformations but these minimal sub- 
stitutions are unconditional. Simple substitution rules 
ought not to be elevated to the level of transformations, 
nor should the words involved be forced to carry with them 
all the structure required for the fully complex case. 
Furthermore, unconditional substitutions of single words 
for single words can be accomplished during the text scan 
itself, not as a transformation of the entire text subsequent 
to scanning. To facilitate the realization of these 
desiderata, any word in the key dictionary, i.e., at the 
top of a key list structure, may be followed by an equal 
sign followed by whatever w'ord is to be its substitute. 
Tranformation rules may, but need not, follow. If none 
do follow such a substitution rule, then the substitution is 
made on the fly, i.e., during text scanning, but the word 
in question is not identified as a keyw'ord for subsequent 
purposes. Of course, a word may be both subtituted for 
and be a keyword as well. An example of a simple sub- 
stitution is 

(YOURSELF - MYSELF). 

Neither “yourself” nor “myself” are keywords in the 
particular script from which this example was chosen. 

The fact that keywords can have ranks or precedences 
has already been mentioned. The need of a ranking mecha- 
nism may be established by an example. Suppose an input 
sentence is “I laiow everybody laughed at me.” A script 
may tag the word “I” as well as the word “ever>'body” 
as a keyword. Without dijGferential ranking, “I” occurring 
first would determine the transformation to be applied. 
A typical response might be “You say you know everybody 
laughed at you.” But the important message in the input 
sentence begins with the word “everybody”. It is very 
often true that when a person speaks in terms of universals 
such as “everybody”, “always” and “nobody” he is really 
referring to some quite specific event or person. By giving 
“everybody” a higher rank than “I”, the response “Who 
in particular are you thinking of” may be generated. 

The specific mechanism employed in ranking is that the 
rank of every keyword encountered (absence of rank 
implies rank equals 0) is compared with the rank of the 
highest ranked keyword already seen. If the rank of the 


new word is higher than that of any previously encoun- 
tered word, the pointer to the transformation, mles 
associated with the new word is placed on top of a list 
called the kej’^tack, otheiwise it Ls placed on the bottom 
of the keystack. When the text scan terminates, the key- 
stack has at its top a pointer as.sociated with the highest 
ranked key'word encountered in the scan. The remaining 
pointers in the stack may not be monotonically ordered 
with respect to the ranks of the words from which they 
were derived, but they are nearly so — in any event they 
are in a useful and interesting order. Figure 2 is a simpli- 
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Fig. 2. Basic dow diagram of kevword detection 


fled flow diagram of keyword detection. The rank of a 
keyword must, of course, also be associated with the 
keyword. Therefore it must appear on the keyword list 
structure. It may be found, if at all, just in front of the 
list of transformation rules associated with the keyword. 
As an example consider the word “MY'” in a panicular 
script. Its keyword list may be as follows: 

(YIY = YOUR 5 (transformation rules)). 

Such a list would mean that whenever the word “MY’” is 
encountered in any text, it would be replaced by the word 
“YOUR”. Its rank would be 5. 

Upon completion of a given text scan, the keystack is 
either empty or contains pointers derived from the key- 
words found in the text. Each of such pointers is actually a 
sequence reader — a Slip mechanism which facilitates 
scanning of lists — pointing into its particular key list in 
such a way that one sequencing operation to the right 
(SEQLR) will sequence it to the first set of tran.sformation 
rules associated with its keyword, i.e., to the list 

((Di) (Ri.i) (Ri , i^ffti)). 

The top of that list, of course, is a list w^hich serves a 
decomposition rule for the subject text. The top of the 
keystack contains the first pointer to be activated. 

The decomposition rule A associated with the keyword 
Kj i.e., 1(A), A" I, is now tried. It may fail however. For 
example, suppose*the input text w’as: 

You are very helpful. 
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The keyword, say, L-s *‘you'', and l^Di), youj is 
H) I remind you <n’ 0). 

(Recall lhat the *you'’ in the original sentence has already 
been replaced by *1'^ in the text now analyzed.) This 
decomposition rule obviously fails to match the input 
sentence. Should i(Z)i), A’l fail to find a match, then 
Kj is tried. Should that too fail, j(Z> 3 ), A'! is 
attempted, and so on. Of course, the set of transformation 
rules can be guaranteed to terminate with a decomposition 
rule which must match. The decomposition rule 

(0 K 0) 

will match any text in which the word K appears w'hile 

iO) 

will match any text whatever. However, there are other 
ways to leave a particular set of transformation rules, as 
will be shown below. For the present, suppose that some 
particular decomposition rule (Z),) has matched the input 
text. fZ>i), of course, ^vas found on a list of the form . 

((Di)(R.,,m,.) ... (A..O). 

Sequencing the reader which is presently pointing at 
(Di) will retrieve the reassembly rule (S*. i) which may 
then be applied to the decomposed input text to \-deld the 
output message. 

Consider again the input text 

You are veiy helpful 

in which “you"’ is the only key word. The sentence is 
transformed during scanning to 

I are very helpful 

{(Di), you! is '*(0 I remind your of 0)” and fails to match 
as already discussed. However, | (D^), you) is “(0 I are 0)'’ 
and obviously matches the text, decomposing it into the 
constituents 

».l) empty (2) I (3) are (4> very helpful. 

‘(Ai. i), you} is 

(What makes you think I am 4) 

Hence it produces the output text 

What makes you think I am very helpful. 

Having produced it, the integer 1 is put in front of (R^, i) 
so that the transformation rule list in question now appears 
as 


that decomposition mle. This mechanism insures that the 
complete set of reassembly rules a.»ociated with u given 
decomposition rule is (wcled through befoi*e any repetitions 
occur. 

The system described so far is essentially one which 
selects a decomposition rule for the highest ranking key- 
w'ord found in an input text, attempts to match that text 
according to that decompo.sition rule and, failing to make 
a match, selects the next reassembly rule associated with 
the matching decomposition rule and applies it to generate 
an output text. It is, in other words, a system which, for 
the highest ranking kejrvvord of a text, selects a specific 
decomposition and reassembly rule to be used in forming 
the output message. 

Were the system to remain that simple, then keywords 
that required identical sets of transformation rules would 
each require that a copy of these transformation rules be 
associated with them. This would be logically sound but 
would complicate the task of script writing and would also 
make unneces.sary’^ storage demands. There are therefore 
special types of decomposition and assembly rules char- 
acterized by the appearance of “ = ” at the top of the 
rule list. The word following the equal sign indicates which 
new set of transformation rules Ls to be applied. For ex- 
ample, the kejnvord “what^’ may have associated with it 
a transformation rule set of the form 

((0) (Why do you ask) (Ij that aa important question) . . .) 


(How (*What)) 

The key^vords *'how'"’, ‘’what'’ and ‘'when’’ may thus be 
made to form an equivalence class with respect to the 
transformation rules which are to apply to them. 

In the above example the rule “( = what)” is in the 
place of a decomposition rule, although it causes no 
decomposition of the relevant text. It may also appear, 
however, in the place of a reassembly rule. For example, 
the keyw’ord “am” may have among others the following 
transformation rule set associated with it: 

((0 are you 0) (Do you believe you axe 4) . . . (—what) . . .) 

(It Is here assumed that **are” has been substituted for 
“am” and “you” for ‘T” in the initial text scan.) Then, 
the input text 

Am I sick 


which would apply equally well to the keywords ‘‘how” 
and “when ”. The entu^ keyword lisf> for “how-’ may 
therefore be 




((D,)l(ff.. r)(Rt. • (fl,. «,)). 

Xext time | (Ds), Aj matches an input text, the reassembly 
rule i7J2. 2 ) will be applied and the integer 2 will replace 
the 1. After (Aa. m.) has been e.xercised, (R 2 , 1 ) will again 
be invoked. Thus, after the system has been in use for a 
time, every decompo.sition rule w’hich has matched some 
input text has associated with it an integer which corre- 
sponds to the last reassembly mle used in connection with 


would elicit either 

Do you believe you are sick 
or 

Why do you ask 

dep>endiiig on how many times the general form had 
already occurred. 

Under still other conditions it may be desirable to 
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perform a preliminary tran^fomiation on the input text 
before subjecting it to the decompositions and reassemblies 
which finally yield the output text. For example, the 
ke\wvord “you're'* should lead to the transformation rules 
associated with “you” but should first be replaced by a 
word pair. The dictionary entry for **you*re** is therefore: 

O'ou're * ((0 Vm 0) (PRE (I XSL 3) (-YOU)))) 

which has the following effect: 

(1) WTierever “you*re” is found in the input text, it is 
replaced by “I*m”. 

(2) If “you're” is actually selected as the regnant 
keyword, then the input text is decomposed into three 
constituent parts, namely, all text in front of the first 
occurrence of “Fm**, the word “Fm” itself, and all text 
following the first occurrence of “I'm”. 

(3) The reassembly rule beginning with the code 
“PRE” is encountered and the decomposed text re- 
assembled such that the words ‘ I AM” appear in front 
of the third constituent determined by the earlier de- 
composition. 

(4) Control is transferred, so to speak, to the trans- 
formation rules associated with the keyword “you”, 
where further decompositions etc. are attempted. 

It is to be noted that the set 

(PRE (I AM 3) (-YOU)) 

is logically in the place of a reassembly rule and may 
therefore be one of many reassembly rules associated with 
the given decomposition. 

.Another form of reassembly mle is 

(NEWKET* 

which serves the case in which attempts to match on the 
currently regnant keyword are to be given up and the 
entire decomposition and reassembly process is to start 
again on the basis of the keyword to be found in the 
keystack. Whenever this rule is invoked, the top of the 
keystack is ‘popped up” once, i.e., the new regnant key- 
word recovered and removed from the keystack, and the 
entire process reinitiated as if the initial text scan had just 
terminated. This mechanism makes it possible to, in effect, 
test on key phrases as opposed to single key words. 

A serious problem which remains to be discussed is the 
reaction of the system in case no keywords remain to 
serve as transformation triggers. This can arise either in 
case the ke}rstack is empty when XEWKEY is invoked or 
when the input text contained no keywords initially. 

The simplest mechanism supplied is in the form of the 
special reserved keyword “XONE” which must be part of 
any’’ script. The script writer must associate the universally 
matching decomposition rule (0) with it and follow this by 
as many content-free remarks in the form of transforma- 
tion rules as he pleases. (Rxamples are: “Please go on”, 
“That's very interesting” and “I see”.) 

There is, however, another mechanism which causes the 
sy^stem to respond more spectacularly in the absence of a 
key. The word “MEMORY” is another reser\’ed pseudo- 
keyword. The key list structure associated with it differs 


from the ordinary one in some respects. An example 
illuminates this point. 

Consider the following structure: 

(MEMORY MY 

(0 YOUR 0 - LETS DISCUSS FURTHER WHY YOUR :3) 
(0 YOUR 0 - EARLIER YOU SAID YOUR 3) 

The word “MY’” (which must be an ordinary keyw'ord 
as well) has been selected to sert^e a special function. 
Whenever it is the highest ranking key^’ord of a text one 
of the transformations on the MEMORY’ list is randomly 
selected, and a copy of the text is transformed accordingly. 
This transformation is stored on a first-in-first-out stack 
for later use. The ordinary processes already described are 
then carried out. When a text without keyrn^ords is en- 
countered later and a certain counting mechanism is in a 
particular state and the stack in question is not empty, 
then the transformed text is printed out as the reply. It 
is, of course, also deleted from the stack of such trans- 
formations. 

The current version of ELIZA requires that one keyrword 
be associated with MEYIORY' and that exactly four 
transformations accompany that word in that context. (An 
application of a transformation rule of the form 
(LEFT H.AND SIDE - RIGHT HAND SIDE) 
is equivalent to the successive application of the two forms 
(LEFT H.\ND SIDE), (RIGHT HAND SIDE).) 

Three more details will complete the formal description 
of the ELIZA program. 

The transformation rule mechanism of Slip is such that 
it permits tagging of words in a text and their subsequent 
recovery on the basis of one of their tags. The keyword 
“MOTHER” in ELIZA, for example, may be identified 
as a noun and as a member of the class “family” as follows: 

(MOTHER DLIST (/NOL'N F.UIILY)). 

Such tagging in no way' interferes with other information 
(e.g., rank or transformation rules) which may be asso- 
ciated with, the given tag word. A decomposition rule may 
contain a matching constituent of the form (/TAGl 
TAG2 • • • ) which will match and isolate a word in the 
subject text having any one of the mentioned tags. If, for 
example, “MOTHER” is tagged as indicated and the 
input text 

‘‘CONSIDER MY AGED MOTHER .\S WELL .\S ME” 
subjected to the decomposition rule 
(0 YOUR 0 (/F.AMILY) 0) 

(remembering that “YIY’” has been replaced by “YOUH”), 
then the decomposition would be 

(1) CONSIDER (2) YOUR (3) AGED (4) MOTHER 

(5) .\S WELL AS ME. 

Another fle.xibility inherent in the Slip text manipula- 
tion mechanism underlying ELIZA is tha or-ing of 
matching criteria is permitted in decomposition rules. 
The above input text would have been decomposed 
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precisely as stated above by the decomposition rule: 

(0 YOUR 0 (^FATHER MOTHER; 0) 

which, by \nrtue of the presence of in the sublist 
structure seen above, would have isolated either the word 
“FATHER*' or “MOTHER" (in that order) in the input 
text, w’hichever occurred first after the first appearance of 
the word “Y’DIJR". 

Finally, the script w’riter must begin his script wdth a 
list, i.e., a message enclosed in parentheses, which contains 
the statement he wishes ELIZA to type w’hen the sj'stem 
is first loaded. This list may be empty. 

Editing of an ELIZA script is achieved \da appeal to a 
contextual editing program (ED) which is part of the 
MAC librar3\ This program is called whenever the input 
text to ELIZA consists of the single word “EDIT". 
ELIZA then puts itself in a so-called dormant state and 
presents the then stored script for editing. Detailed 
description of ED is out of place here. Suffice it to say that 
changes, additions and deletions of the script may be made 
with considerable efficiency and on the basis of entirely 
contextual cues, i.e., without resort to line numbers or 
any other artificial devices. When editing is completed, 
ED is given the command to FILE the re\Tsed script. The 
new script is then stored on the disk and read into ELIZA. 
ELIZA then types the w’ord “START" to signal that the 
conversation may resume under control of the new script. 

An important consequence of the editing facility built 
into ELIZA is that a given ELIZA script need not start 
out to be a large, full-blown scenario. On the contrary', it 
should begin as a quite modest set of keywords and 
transformation rules and permitted to be grown and 
molded as experience with it builds up. This appears to 
be the best way to use a truly interactive man-machine 
facility — i.e., not as a detdce for rapidly debugging a code 
representing a fulh^ thought out solution to a problem, but 
rather as an aid for the exqDloration of problem sohdng 
strategies. 

Discussion 

At this writing, the only serious ELIZA scripts which 
exist are some which cause ELIZA to respond roughly as 
would certain psychotherapists (Rogerians). ELIZA 
performs best when its human correspondent is initiaUy 
instructed to “talk" to it, via the typewriter of course, 
just as one would to a psychiatrist. This mode of con- 
versation w^as chosen because the psychiatric interview 
is one of the few examples of categorized dyadic natural 
language commimication in w’hich one of the participating 
pair is free to assume the pose of knowing almost nothing 
of the real world. If, for example, one were to tell a psy- 
chiatrist “I went for a long boat ride" and he responded 
“Tell me about boats", one would not assume that he knew 
nothing about boats, but that he had some purpose in so 
directing the subsequent conversation. It is important to 
note that this assumption is one made by the speaker. 
Whether it is realistic or not is an altogether separate 
question. In any case, it has a crucial psychological utility 


in that it ser\'es the si>eaker to maintain his sense of bt-ii. 
heard and understood. The speaker further defend? his 
impression (which even in real life may be illusory') by 
attributing to his conversational partner all sorts of back- 
ground knowledge, insights and reasoning ability. But again, 
these are the speaker's contribution to the conversation. 
They manifest thenx'^elves inferentially in the interpretations 
he makes of the offered responses. F rom the purely technical 
programming point of view then, the psychiatric inter\'iew 
form of an ELIZA script has the advantage that it elimi- 
nates the need of storing explicit information about the 
real world. 

The human speaker will, as has been said, contribute 
much to clothe ELIZA’S responses in vestments of 
plaasibility. But he ^vill not defend his illusion (that he is 
being understood) against all odds. In hunian conversation 
a speaker will make certain (perhaps generous) assump- 
tions about his conversational partner. As long as) it 
remains possible to interpret the latter’s responses con- 
sistently with those assumptions, the speaker’s image of 
his partner remains unchanged, in particular, undamaged. 
Responses w'hich are difficult to so interpret may w’ell 
result in an enhancement of the image of the panner, in 
additional rationalizations which then make more com- 
plicated interpretations of his responses reasonable. 
WTien, howrever, such rationalizations become too massive 
and even self-contradictory, the entire image may crumble 
and be replaced by another (“He is not, after all, as smart 
as I thought he was"). When the conversational partner 
is a machine (the distinction between machine and program 
is here not useful) then the idea of credibility may w^ell be 
substituted for that of plausibility in the above. 

WTth ELI2iA as the basic vehicle, experiments may be 
set up in which the subjects find it credible to believe that 
the responses which appear on his tjq^ewTiter are gener- 
ated by a human sitting at a similar instrument in another 
room. How must the script be written in order to maintain 
the credibility of this idea over a long period of time? 
How can the performance of ELIZA be systematically 
degraded in order to achieve controlled and predictable 
thresholds of credibility in the subject? What, in all tliis, 
is the role of the initial instruction to the subject? On the 
other hand, suppose the subject is told he is communicating 
with a machine. What is he led to believe about the 
machine as a result of his conversational experience with 
it? Some subjects have been very hard to convince that 
ELIZA (with its present script) is not human. This is a 
striking form of Turing’s test. WTiat experimental design 
would make it more nearly rigorous and airtight? 

The whole issue of the credibility (to humans) of 
machine output demands investigation. Important de- 
cisions increasingly tend to be made in response to com- 
puter output. The ultimately responsible human inter- 
preter of “What the machine says" is, not unlike the 
correspondent with ELIZA, constantly faced with the 
need to make credibility judgments. ELIZA shows, if 
nothing else, how’ easy it is to create and maintain the 
illusion of understanding, hence perhaps of judgment 
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desen^ing of credibility. A certain danger lurks there. 

The idea that the present ELIZA script contains no 
information about the real world is not entirely true. For 
example, the transformation rules which cause the input 

Everybody hates me 
to be transformed to 

Can you think of anyone in particular 

and other such are based on quite specific hypotheses about 
the world. The whole script constitutes, in a loose way, a 
model of certain aspects of the world. The act of \vriting a 
script is a kind of programming act and has all the advan- 
tages of programming, most particularly that it clearly 
shows where the programmer's understanding and com- 
mand of his subject leaves off. 

A large part of whatever elegance may be credited to 
ELIZA lies in the fact that ELIZA maintains the illusion 
of understanding with so little machinery. But there are 
bounds on the extendability of ELIZA'S “imderstanding" 
power, which are a function of the ELIZA program itself 
and not a function of any script it may be given. The 
crucial test of understanding, as every teacher should 
Icnow, is not the subject's ability to continue a conversa- 
tion, but to draw valid conclusions from what he is being 
told. In order for a computer program to be able to do 
that, it must at least have the capacity to store selected 
parts of its inputs. ELIZA throws away each of its inputs, 
except for those few transformed by means of the 
MEMORY machinery. Of course, the problem is mere 
than one of storage. A great part of it is, in fact, subsumed 
under the word ‘"selected" used just above. ELIZA in its 
use so far has had as one of its principal objectives the 
concealment of its lack of understanding. But to encourage 
its conversational partner to offer inputs from which it 
can select remedial information, it must reveal its mis- 
understanding. A switch of objectives from the conceal- 
ment to the revelation of misunderstanding is seen as a 
precondition to making an ELIZA-like program the basis 
for an effective natural language man-machine com- 
munication system. 

One goal for an augmented ELIZA program is thus a 
system which already has access to a store of information 
about some aspects of the real world and which, by means 
of conversational interaction with people, can reveal both 
what it knows, i.e., behave as an information retrieval 
sj’^tem, and where its knowledge ends and needs to be 
augmented. Hopefully the augmentation of its knowledge 
will also be a direct consequence of its conversational 
experience. It is precisely the prospect that such a program 
will converse with many p>eople and learn something from 
each of them, which leads to the hope that it will prove an 
interesting and even useful conversational partner. 

One way to state a slightly different intermediate goal is 
to say that ELIZA should be given the power to slowly 
build a model of the subject conversing with it. If the 
subject mentions that he is not married, for example, and 
later speaks of his wife, then ELIZA should be able to 


make the tentative iiueience that he is either a widower 
or divorced. Of course, he could simply be confused. In 
the long run, ELIZA should be able to build up a helief 
structure (to use Abelson's phra.se) of the subject and on 
that basis detect the subject's rationalizations, contra- 
dictions, etc. Conversations with such an ELIZA would 
often turn into arguments. Important step.s in the realiza- 
tion of these goals have already been taken. Most notable 
among these is Abelson's and Carroll's work on simulation 
of belief structures [1]. 

The script that has formed the basis for most of this 
discussion happens to be one with an overwhelmingly 
psychological orientation. The reason for this has already 
been discussed. There is a danger, however, that the 
example will run away with what it is suppo.sed to illus- 
trate. It is useful to remember that the ELIZA program 
itself is merely a translating processor in the technical 
programming sense. Com [21 in a paper on language 
systems says: 

Given a language which already possesses semantic content, rhen 
a translating processor, even if it operates only syntactically, 
generates corresponding expressions of another language to which 
we can attribute as "meanings” (possibly multiple — the translator 
may not be one to one) the ‘"semantic intents” of the generating 
source e.xpressions; whether we find the result consistent or useful 
or both is, of course, another problem. It is quite possible that by 
this method the same syntactic object language can be usefully 
assigned multiple meanings for each e.xpression . . . 

It is striking to note how well his words fit ELIZA. The 
“given language" is English as is the ‘‘other language", 
expressions of which are generated. In principle, the given 
language could as well be the kind of English in which 
“word problems" in algebra are given to high school 
students and the other language, a machine code allowing 
a particular computer to “solve" the stated problems. 
(See Bobrow's program STUDEXT [3].) 

The intent of the above remarks is to further rob ELIZA 
of the aura of magic to which its application to psycho- 
logical subject matter has to some extent contributed. 
Seen in the coldest possible light, ELIZA is a translating 
processor in Corn's sense; however, it is one which has 
been especially constructed to work well with natural 
language text. 
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APPENDIX. An ELIZA Script 


(HOW 00 YOU 00. PLEASE TELL ME YOUR PROBLEM) 

START 

(SORRY ((0) (PLEASE OON'T APOLIGIZE) 

(APOLOGIES ARE NOT NECESSARY) (WHAT PEELINGS 
00 YOU HAVE WHEN YOU APOLOGIZE) (I’VE TOLD YOU 
THAT APOLOGIES ARE NOT REQUIRED))) 

(OONT • DON’T) 

(CANT ■ CAN'T) 

(WONT • WON'T) 

(REMEMBER S 

((0 YOU REMEMBER 0) (00 YOU OFTEN THINK OF k) 

(DOES THINKING OF U BRING ANYTHING ELSE TO MINO) 

(WHAT ELSE DO YOU REMEMBER) 

(WHY 00 YOU REMEMBER k JUST NOW) 

(WHAT IN THE PRESENT SITUATION REMINDS YOU OF k) 

(WHAT IS THE CONNECTION BETWEEN ME AND U)) 

((0 DO I REMEMBER 0) (010 YOU THINK I WOULD FORGET 5) 

(WHY 00 YOU think I SHOULD RECALL 5 NOW) 

(WHAT about 5) (-WHAT) (YOU MENTIONED 5)) 

((0) (NEWKEY)}) 

(IF 3 ((0 IF 0) (00 YOU THINK ITS LIKELY THAT 3) (00 YOU WISH THAT 3) 
(WHAT 00 YOU THINK ABOUT 5) (REALLY, 2 3))) 

(WHAT 00 YOU THINK ABOUT 3) (REALLY, 2 3))) 

(DREAMT A ((0 YOU DREAMT 0) 

(REALLY, d) (HAVE YOU EVER FANTASIEO b WHILE YOU WERE AWAKE) 

(HAVE YOU DREAMT b BEFORE) (-DREAM) (NEWKFY))) 

(DREAMED - DREAMT k (-DREAMT)) 

(DREAM 3 ((0) (WHAT DOES THAT DREAM SUGGEST TO YOU) 

(DO YOU DREAM OFTEN) (WHAT PERSONS APPEAR IN YOUR DREAMS) 

(DON'T YOU BELIEVE THAT DREAM HAS SOMETHING TO HO WITH 
YOUR PROBLEM) (NEWKEY))) 

(DREAMS - DREAM 3 (-DREAM)) 

(HOW (-WHAT)) 

(WHEN (-HHAT)j 
(ALIKE 10 (-OIT)) 

(SAME 10 (-0IT)) 

(CERTAINLY (-YES)) 

(FEEL OLIST(/BELIEF)) 

(THINK OLIST(/BELIEF)) 

(BELIEVE OLIST(/BELIEF)) 

(WISH 0LIST(/BELIEF}) 

(MEMORY MY (0 YOUR 0 - LETS DISCUSS FURTHEp W-v yOUR 3) 

(0 YOUR 0 - EARLIER YOU SAID YOUR 3) 

(0 YOUR 0 ■ BUT YOUR 3) 

(0 YOUR 0 • DOES that HAVE ANYTHING TO DO WITH TM£ FACT THAT YOUR 3)) 
(NONE ((0) (I AM not sure I UNDERSTAND YOU FULLY) 

(PLEASE GO ON) 

(WHAT DOES THAT SUGGEST TO YOU) 

(DO YOU FEEL STRONGLY ABOUT DISCUSSING SUCH THINGS))) 

(PERHAPS ((0) (YOU OON'T SEEM QUITE CERTAIN) 

(WHY THE UNCERTAIN TONE) 

(CAN'T YOU BE MORE POSITIVE) 

(YOU AREN'T SURE) (DON'T YOU KNOW))) 

(MAYBE (-PERHAPS)) 

(NAME IS ((0) (I AM not interested IN NAMES) 

(I'VE TOLD YOU BEFORE, I DON'T CARE ABOUT NAMES - 
PLEASE CONTINUE)) ) 

(OEUTSCH (-XFREMO)) 

(FRANCAIS (-XFREMO)) 

(ITALIANO (-XFREMO)) 

(ESPANOL (-XFREMD)) 

(XFREMO ((0) (I AM SORRY, I SPEAK ONLY ENGLISH))) 

(HELLO ((0) (HOW DO YOU DO. PLEASE STATE YOUR PROBLEM))) 

(COMPUTER 50 ((0) (DO COMPUTERS WORRY YOU) 

(WHY DO YOU MENTION COMPUTERS) (WHAT DO YOU THINK MACHINES 
HAVE TO 00 WITH YOUR PROBLEM) (DON'T YOU THINK COMPUTERS CAN 
HELP PEOPLE) (WHAT ABOUT MACHINES WORRIES YOU) (WHAT 
DO YOU THINK ABOUT MACHINES))) 

(MACHINE SO (-COMPUTER)) 

(MACHINES SO (-COMPUTER)) 

(COMPUTERS SO (-COMPUTER)) 

(AM - ARE ((0 ARE YOU 0) (DO YOU BELIEVE YOU ARE b) 


(WOULD YOU WANT TO BE b ) (YOU WISH I WOULD TELL YOU YOU ARE b) 
(WHAT WOULD IT MEAN IF YOU WERE b) (-WHAT)) 

((0) (WHY DO YOU SAY 'AM') (I DON'T UNDERSTANP THAT))) 

(ARE ((0 ARE I 0 ) 

(WHY ARE YOU INTERESTED IN WHETHER I AM I* OR NOT) 

(WOULD YOU PREFER IF I WEREN'T b) (PERHAPS I AM u I N YOUR 
FANTASIES) (DO YOU SOMETIMES THINK I AM b) (-WHAT)) 

((0 ARE 0) (DID YOU THINK THEY MIGHT NOT BE 3) 

(WOULD YOU LIKE IT IF THEY WERE NOT 3) (WHAT IF TM£Y WERE NOT 3) 
(POSSIBLY THEY ARE 3)) ) 

(YOUR -MY ((0 MY 0) (WHY ARE YOU CONCERNED OVER MY 3) 

(WHAT ABOUT YOUR OWN 3) (ARE YOU WORRIED ABOUT SOMEONE ELSES 3) 
(REALLY, MY 3))) 

(WAS 2 ((0 WAS YOU 0 ) 

(WHAT IF YOU WERE b) (DC YOU THINK YOU WERE b) 

(WERE YOU b) (WHAT WOULD IT MEAN IF YOU WERE b) 

(WHAT DOES ' b ' SUGGEST TO YOU) (-WHAT)) 

((0 YOU WAS 0) 

(WERE YOU REALLY) (WHY DC YOU TELL ME YOU WERE b NOW) 

(PERHAPS I already KNEW YOU WERE b) ) 

((0 WAS I 0) (WOULD YOU LIKE TO RELIEVE I WAS b) 

(WHAT SUGGESTS THAT I WAS b) 

(WHAT DO YOU THINK) (PERHAPS I WAS b) 

(WHAT IF I HAD BEEN b)) 

((0) (NEWKEY)) ) 

(WERE - WAS (-WAS)) 

(ME • YOU) 

(YOU'RE - I'M ((0 I'M 0) (PRE (I ARE 3) (-YOU)))) 

(I'M - YOU'RE ((0 YOU'RE 0) (PRE (YOU ARE 3) (-I)))) 

(MYSELF - YOURSELF) 

(YOURSELF - MYSELF) 

(MOTHER DLIST(/NOUN FAMILY)) 

(MOM - mother DLIST(/ FAMILY)) 

(DAD - father 0LIST(/ FAMILY)) 

(FATHER DLIST(/N0UN FAMILY)) 

(SISTER DLIST(/FAMILY)) 

(BROTHER DLIST(/FAMILY)) 

(WIFE DLIST(/FAMILY)) 

(CHILDREN DLIST(/FAMI LY)) 

(1 - YOU 

{(0 YOU (• WANT NEED) 0) (WHAT WOULD IT MEAN TO YOU I F YOU GOT b) 
(WHY DO YOU WANT b) (SUPPOSE YOU GOT b SOON) (WHAT 
IF YOU NEVER GOT b) (WHAT WOULD GETTING b MEAN TO 
YOU) (WHAT DOES WANTING b HAVE TO 00 WITH THIS DISCUSSION)) 

((0 YOU ARE 0 (-SAD UNHAPPY DEPRESSED SICK ) 0) 

(I AM SORRY TO HEAR YOU ARE 5) (DO YOU THINK COMING HERE 
WILL HELP YOU NOT TO BE S) (I'M SURE ITS NOT PLEASANT TO 
BE 5) (CAN YOU EXPLAIN WHAT MADE YOU 5)) 

((0 YOU ARE 0 (-HAPPY ELATED GLAD BETTER ) 0) 

(HOW HAVE I HELPED YOU TO BE 5) 

(HAS YOUR TREATMENT MADE YOU 5) (WHAT MAKES YOU S JUST 
NOW) (CAN YOU EXPLAIN WHY YOU ARE SUDDENLY S)) 

((0 YOU WAS 0) (-WAS)) 

((0 YOU (/BELIEF) YOU 0) (00 YOU REALLY THINK SO) (BUT YOU ARE 
NOT SURE YOU S) (00 YOU REALLY DOUBT YOU S)) 

((0 YOU 0 (/BELIEF) 0 I 0) (-YOU)) 

((0 YOU ARE 0) 

(IS IT BECAUSE YOU ARE b THAT YOU CAME TO ME) 

(HOW LONG HAVE YOU BEEN b) 

(DO YOU BELIEVE IT NORMAL TC BE b) 

(DO YOU ENJOY BEING b)) 

((0 YOU (• CAN'T CANNOT) 0) (HOW DO YOU KNOW YOU CAN'T b) 

(HAVE YOU TRIED) 

(PERHAPS YOU COULD b NOW) 

(DO YOU REALLY WANT TO BE ABLE TO b)) 

((0 YOU OON'T 0)(OON'T YOU REALLY b)(WHY DON'T YOU b) 

(DO YOU WISH TO BE ABLE TO b) (POES THAT TROUBLE YOU)) 

((0 YOU FEEL 0) (TELL ME MORE ABOUT SUCH FEELINGS) 

(DO YOU OFTEN FEEL b) 

(DO YOU ENJOY FEELING b) 

(OF WHAT DOES FEELING b REMIND YOU)) 

((0 YOU 0 I 0) (PERHAPS IN YOUR FANTASY WE 3 EACH OTHER) 

(DO YOU WISH TO 3 ME) 

(YOU SEEM TO NEED TO 3 ME) 

(00 YOU 3 ANYONE ELSE)) 
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((0) (YOU SAY 1) 

(CAN YOU ELABORATE ON THAT) (00 YOU SAY I FOR SOME SPECIAL REASON) 
(THAT’S QUITE INTERESTING))) 

(YOU • I ((01 remind you of 0) (•OIT)) 

((0 I ARE 0) (WHAT MAKES YOU THINK I AM W) 

(DOES IT PLEASE YOU TO BELIEVE I AM it) 

(00 YOU SOMETIMES WISH YOU WERE W ) 

(PERHAPS YOU WOULD LIKE TO BE it)) 

((01 0 YOU) (WHY 00 YOU THINK I 5 YOU) 

(YOU LIKE TO THINK I 3 YOU - DON'T YOU) 

(WHAT MAKES YOU THINK I 3 YOU) 

(REALLT« I 3 YOU) (DO YOU WISH TO 8FLI EVE I 3 YOU) 

(SUPPOSE I DIO 3 YOU - WHAT WOULD THAT MEAN) 

(DOES SOMEONE ELSE BELIEVE I 3 YOU)) 

((0 I 0) (WE WERE DISCUSSING YOU - NOT ME) 

(OH, I 3) (YOU'RE NOT REALLY TALKING ABOUT ME - ARE YOU) 

(WHAT ARE YOUR FEELINGS NOW))) 

(YES ((0) (YOU SEEM QUITE POSITIVE) (YOU ARE SURE) 

(I SEE) (I UNDERSTAND))) I 

(NO ((0) (ARE YOU SAYING 'NO' JUST TO BE NEGATIVE) ! 

(YOU ARE BEING A BIT NEGATIVE) (WHY NOT) (WHY 'NO'))) ( 

(MY • YOUR 2 ((0 YOUR 0 (/FAMILY) 0) 

(TELL ME MORE ABOUT YOUR FAMILY) ( WHO ELSE IN YOUR FAMILY 
5) (YOUR U) (WHAT ELSE COMES TO MIND WHEN YOU THINK OF 
YOUR It)) 

((0 YOUR 0) (YOUR 3) (WHY DO YOU SAY YOUR 3) (POES THAT 
SUGGEST ANYTHING ELSE WHICH BELONGS TO YOU) (IS IT 

important to you that 2 5))) 

(CAN ((0 CAN I 0) (YOU BELIEVE I CAN It DON'T YOU) (-WHAT) 

(YOU WANT ME TO BE ABLE TO it) (PERHAPS YOU WOULD LIKE TO BE 
ABLE TO It YOURSELF)) ((0 CAN fOU 0) (WHETHER OR NOT YOU CAM it 

DEPENDS ON YOU MORE THAN ON ME) (DO YOU WANT TO BE ABLE TO It) ‘ 

(PERHAPS YOU DON'T WANT TO 4) (-WHAT))) 

(WHAT ((0) (WHY DO YOU ASK) (POES THAT QUESTION INTEREST YOU) i 

(WHAT IS IT YOU REALLY WANT TO KNOW) j 

(ARE SUCH QUESTIONS MUCH ON YOUR MIND) 

(WHAT answer WOULD PLEASE YOU MOST) 

(WHAT DO YOU THINK) (WHAT COMES TO YOUR MIND WHEN YOU ASK THAT) 

(HAVE YOU ASKED SUCH QUESTION BEFORE) I 

(HAVE YOU ASKED ANYONE ELSE))) | 

(BECAUSE ((0) (IS THAT THE REAL REASON) (PON'T AMY OTHER REASONS } 

COME TO MIND) (DOES THAT REASON SEEM TO EXPLAIN ANYTHING ELSE) 

(WHAT OTHER REASONS MIGHT THERE BE))) 

(WHY ((0 WHY DON'T I 0) (PO YOU BELIEVE I DON'T 5) (PERHAPS I | 

WILL 5 IN GOOD TIME) (SHOULD YOU S YOURSELF) (YOU WANT ME TO 5) j 

(■WHAT)) I 

((0 WHY CAN'T YOU 0) (DO YOU THINK YOU SHOULD RE ABLE TO S) | 

(DO YOU WANT TO BE ABLE TO S) (PO YOU BELIEVE THIS WILL HELP YOU j 

TO 5) (HAVE YOU ANY IDEA WHY YOU CAN'T 5) (-WHAT)) 1 

(• WHAT)) I 

(EVERYONE 2 ((0 (• EVERYONE EVERYBODY NOBODY NOONE) 0 ) | 

(REALLY, 2) (SURELY NOT 2) (CAN YOU THINK OF | 

ANYONE IN PARTICULAR) (WHO, FOR EXAMPLE) (YOU ARE THINKING OF j 

A VERY special PERSON) ^ 

(WHO, MAY I ASK) (SOMEONE SPECIAL PERHAPS) | 

(YOU HAVE A PARTICULAR PERSON IN MIND, DON'T YOU) (WHO DO YOU I 

THINK YOU'RE TALKING ABOUT))) 

(EVERYBODY 2 (- EVERYONE)) ! 

(NOBODY 2 (-EVERYONE)) | 

(NOONE 2 (-EVERYONE)) I 

(ALWAYS I ((0) (CAN YOU THINK OF A SPECIFIC EXAMPLE) (WHEN) 

(WHAT INCIDENT ARE YOU THINKING OF) (REALLY, ALWAYS))) 

(LIKE 10 ((0 (-AM IS ARE WAS) 0 LIKE 0) (-OIT)) 

((0) (NEWKEY)) ) 

(OIT ((0) (IN WHAT WAY) (WHAT RESEMBLANCE DO YOU SEE) ' 

(WHAT DOES THAT SIMILARITY SUGGEST TO YOU) 

(WHAT OTHER CONNECTIONS DO YOU SEE) | 

(WHAT DO YOU SUPPOSE THAT RESLMBLANCE MEANS) 

(WHAT IS THE CONNECTION, DO YOU SUPPOSE) 

(COULD there really be SOME CONNECTION) 

(HOW))) 

() 
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